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DETAILED ACTION 

The response received on 1 1/11 /2008 lias been placed in tine file and was 
considered by the examiner. An action on the merit follows. 

Response to Amendment 

1 . The amendments filed on 1 1 November 2008 have been fully considered. 
Response to these amendments is provided below. 

Summary of Amendment/ Arguments and Examiner's Response: 

2. The applicant has submitted amendments to the drawings. The drawings were 
received onl 0/7/2008. These drawings are accepted. 

3. The applicant has amended the claims to further define the boosting filter stage. 
The applicant argues that Viola only shows a cascade of nodes. 

4. With further consideration/ search, the examiner has found that Viola does define 
a bootstrap function, even though it is not shown in the cited figure. Viola defines such 
a bootstrap function in the training stage. The examiner has taken note of another 
reference that shows that the training of Viola is actually a bootstrap function, since 
Viola never makes use of the terminology "boot strap". 

Claim Rejections - 35 USC §112 

5. The following is a quotation of the second paragraph of 35 U.S.C. 1 1 2: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 
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6. Claims 1, 26-31 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 

7. Claim 1 recites the limitation "the booster filter stage" in line 4. There is 
insufficient antecedent basis for this limitation in the claim. The applicant previously 
claims a "boosting filter stage." The examiner believes the applicant intends to claim 
that the two terms are one in the same, so the claims are interpreted as such. 



Claim Rejections - 35 USC § 101 

8. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for 
Patent Subject Matter Eligibility" ( Official Gazette notice of 22 
November 2005 ). Annex IV, reads as follows: 

Descriptive material can be characterized as either "functional descriptive material" or "nonfunctional 
descriptive material." In this context, "functional descriptive material" consists of data structures and 
computer programs which impart functionality when employed as a computer component. (The 
definition of "data structure" is "a physical or logical relationship among data elements, designed to 
support specific data manipulation functions." The New IEEE Standard Dictionary of Electhcal and 
Electronics Terms 308 (5th ed. 1993).) "Nonfunctional descriptive material" includes but is not limited 
to music, literary works and a compilation or mere arrangement of data. 

When functional descriptive material is recorded on some computer-readable medium it becomes 
structurally and functionally interrelated to the medium and will be statutory in most cases since use of 
technology permits the function of the descriptive material to be realized. Compare In re Lowry, 32 
F.3d 1579, 1583-84, 32 USPQ2d 1031, 1035 (Fed. Cir. 1994) (claim to data structure stored on a 
computer readable medium that increases computer efficiency held statutory) and Warmerdam, 33 
F.3d at 1 360-61 , 31 USPQ2d at 1 759 (claim to computer having a specific data structure stored in 
memory held statutory product-by-process claim) with Warmerdam, 33 F.3d at 1361, 31 USPQ2d at 
1760 (claim to a data structure per se held nonstatutory). 

In contrast, a claimed computer-readable medium encoded with a computer program is a computer 
element which defines structural and functional interrelationships between the computer program and 
the rest of the computer which permit the computer program's functionality to be realized, and is thus 
statutory. See Lowry, 32 F.3d at 1583-84, 32 USPQ2d at 1035. 
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9. Claims 1 and 26-31 are/are rejected under 35 U.S.C. 101 as not falling within 
one of the four statutory categories of invention. Supreme Court precedent^ and recent 
Federal Circuit decisions^ indicate that a statutory "process" under 35 U.S.C. 101 must 
(1) be tied to another statutory category (such as a particular apparatus), or (2) 
transform underlying subject matter (such as an article or material) to a different state or 
thing. While the instant claim(s) recite a series of steps or acts to be performed, the 
claim(s) neither transform underlying subject matter nor positively tie to another 
statutory category that accomplishes the claimed method steps, and therefore do not 
qualify as a statutory process. For example, the applicant has only recited 2 
processing steps but does not state that the steps are processed using a particular 
apparatus/ computer processor. 

1 0. Claims 55, 57-59 and 67 are rejected under 35 U.S.C. 1 01 because the claimed 
invention is directed to non-statutory subject matter as follows. Claim 55 defines an 
"apparatus". However, while the preamble defines an "apparatus", the body of the claim 
lacks definite structure indicative of a physical apparatus. Furthermore, the 
specification indicates that the invention may be embodied as pure software (paragraph 
45 of the PG Pub). Therefore, the claim as a whole appears to be nothing more than an 
"apparatus" of software elements, thus defining functional descriptive material per se. 



' Diamond v. Diehr, 450 U.S. 175, 184 (1981); Parker v. Flook, 437 U.S. 584, 588 n.9 (1978); Gottschalk v. 
Benson, 409 U.S. 63, 70 (1972); Cochrane v. Deener, 94 U.S. 780, 787-88 (1876). 
^ In re Bilski, 88 USPQ2d 1385 (Fed. Cir. 2008). 
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Functional descriptive material may be statutory if it resides on a "computer- 
readable medium or computer-readable memory". The claim(s) indicated above lack 
structure, and do not define a computer readable medium and are thus non-statutory for 
that reason (i.e., "When functional descriptive material is recorded on some computer- 
readable medium it becomes structurally and functionally interrelated to the medium 
and will be statutory in most cases since use of technology permits the function of the 
descriptive material to be realized" - Guidelines Annex IV). The scope of the presently 
claimed invention encompasses products that are not necessarily computer readable, 
and thus NOT able to impart any functionality of the recited program. The examiner 
suggests: 

1 . Amending the claim(s) to embody the program on "computer-readable 
medium" or equivalent; assuming the specification does NOT define the computer 
readable medium as a "signal", "carrier wave", or "transmission medium" which are 
deemed non-statutory; or 

2. Adding structure to the body of the claim that would clearly define a 
statutory apparatus. 

Any amendment to the claim should be commensurate with its corresponding 
disclosure. 

Claim Rejections - 35 USC § 102 

1 1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 
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A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

1 2. Claims 55, 57-59 and 67 are rejected under 35 U.S.C. 1 02(b) as being 
unpatentable by "Robust Real-Time Object Detection" (Viola et al) and noted with 
"Neural Network Based Face Detection (Rowley et al). 

Regarding claim 55, Viola et al discloses an apparatus, that which does all the 
processing of Viola comprising: logic (tables 1 and 2, whole document describes the 
logic) operatively configured to detect at least one human face within a digital image 
(page 1 , paragraph 2, lines 2-3) using a multiple stage face detection process (page 2) 
that includes: a boosting filter stage to process a set of initial candidate portions of 
digital image data carried out by AdaBoost using a boosting chain (fig. on page 12) to 
produce a set of intermediate candidate portions (page 2, paragraph 4), wherein the 
boosting chain includes a plurality of boosting chain nodes/ classifiers (1 , 2, 3 are the 
three nodes shown on the fig. on page 12) to identify candidate portions (page 12, 
paragraph 3 and fig. on page 12, the output of further processing), and a function 
following each of the plurality of boosting chain nodes during training, since each 
classifier contains a function that processes negative examples to see if there are many 
false positives (page 14, paragraph 3), and the function uses false alarms collected 
from non-face image sets (table 2, N) as a negative training set to initiate a subsequent 
boosting chain node by creating another layer if there are too many false alarms (page 
14, paragraph 3). It is noted that Rowley et al discloses it is known in facial detection 
that training sets by using non-faces is called a "bootstrap method" (page 1, paragraph 
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3- page 2, paragraph 1 ); therefore, since the same is being done in Viola, Viola 
discloses such a bootstrap function. Furthermore, Viola et al discloses a post-filter 
stage configured to process said set of intermediate candidate portions to produce a set 
of final candidate portions, "promising regions" (page 2, paragraph 5). The post filter 
stage is more complex processing of finding a face (page 2, paragraph 5). 

1 3. Regarding claim 57, Viola et al discloses processing said plurality of portions 
using a pre-filter stage that is configured to output said set of initial candidate portions 
selected from said plurality of portions based on at least one feature, a Haar- like 
feature (page 2, paragraph 3). 

14. Regarding claim 58, Viola et al discloses that the feature is a Haar- like feature 
(page 2, paragraph 3, lines 3-4). 

1 5. Regarding claims 59, by reinterpreting the pre-filter stage of Viola et al as being 
the first part "the integral image" (page 2, paragraph 3) and also part of the AdaBoost 
procedure as well from page 2, paragraph 4 and figure 6, items 1 and 2, the boosting 
chain step will be interpreted as the rest of the AdaBoost procedure that is not part of 
the pre-filter stage (fig. 6, item 3), and the post filtering stage is the "further processing" 
of fig. 6. Therefore, Viola et al discloses that the pre-filter stage includes a linear filter, 
since items 1 and 2 are filtering out rejections and are arranged in a linear fashion. The 
filter is based on a weak learner (page 12, paragraph 1). 

16. Regarding claim 67, Viola et al employs a feature-based algorithm in a prefilter 
stage (page 2, paragraph 3) and the feature includes a Haar-like feature (page 2, 
paragraph 3, lines 3-4). 
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Claim Rejections - 35 USC § 103 

1 7. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not Identically disclosed or described as set 
forth In section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
Invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the Invention was made. 

18. Claims 1 , 26-31 , 41 , 43-45 and 51 are rejected under 35 U.S.C. 1 03(a) as being 
and unpatentable over Viola et al in view of "A Subspace Approach to Face Detection 
with Support Vector Machines" (Ai et al) and noted with Rowley et al. 

Regarding claim 1 , Viola et al discloses a method for use in detecting faces 
within a digital image (page 1, paragraph 2, lines 2-3), the method comprising: 
processing a set of initial candidate portions that are "integral images", of digital image 
data, in a boosting filter stage that uses a boosting chain (fig on page 12), or interpreted 
as each stage as part of a chain, carried out by AdaBoost to produce a set of 
intermediate candidate portions (page 2, paragraph 4); and processing said set of 
intermediate candidate portions in a post-filter stage to produce a set of final candidate 
portions, "promising regions" (page 2, paragraph 5). The post filter stage is more 
complex processing of finding a face (page 2, paragraph 5). Viola et al further discloses 
that the boosting filter stage includes a chain having a plurality of boosting chain nodes/ 
classifiers (1 , 2, 3 are the three nodes shown on the fig. on page 12) to identify 
candidate portions (page 12, paragraph 3 and fig. on page 12, the output of further 
processing), and a function following each of the plurality of boosting chain nodes 
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during training, since each classifier contains a function tliat processes negative 
examples to see if there are many false positives (page 14, paragraph 3), and the 
function uses false alarms collected from non-face image sets (table 2, N) as a negative 
training set to initiate a subsequent boosting chain node by creating another layer if 
there are too many false alarms (page 14, paragraph 3). 

Viola does not disclose expressly that more complex processing to find a face 
includes an image pre-processing process, a color-filter process, and a support vector 
machine process and that a the function using false positives is called "bootstrap 
function." 

It is noted that Rowley et al discloses it is known in facial detection that training 
sets by using non-faces is called a "bootstrap method" (page 1 , paragraph 3- page 2, 
paragraph 1); therefore, since the same is being done in Viola, Viola discloses such a 
bootstrap function. 

Ai et al discloses a way of finding a face includes an image pre-processing 
process: creating a skin color model or training images, etc (fig. 1), a color-filter process 
(fig. 1, "Skin color segmentation), and an SVM process (fig. 1, "Linear SVM classifier"). 

Viola et al and Ai et al are combinable because they are from the same field of 
endeavor, i.e. facial image detection. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to use the process of pre-processing, color-filtering, and SVM to detect 
faces. 
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The suggestion/motivation for doing so would have been to provide the most 
robust method by providing an easier and efficient way to find faces. 

Therefore, it would have been obvious to combine the boosting chain of Viola 
with the face detection of Ai et al to obtain the invention as specified in claim 1 . 
1 9. Regarding claim 41 , Viola et al discloses a computer-readable medium having 
computer-implementable instructions for causing at least one processing unit to perform 
acts comprising: detecting possible human face image data within a digital image (page 
1 , paragraph 2, lines 2-3) using a multiple stage face detection scheme (page 2) that 
includes: a boosting filter stage to process a set of initial candidate portions of digital 
image data carried out by AdaBoost to produce a set of intermediate candidate portions 
(page 2, paragraph 4), using a plurality of boosting chain nodes (fog. On page 12, 
classifiers 1 ,2, and 3) and a boot strap function (as noted above in the citation of 
Rowley et al) following each of the plurality of boosting chain nodes during training, 
since each classifier contains a function that processes negative examples during 
training (page 14, paragraph 3), the boot strap function to: collect false alarms in non — 
face image sets (table 2, N) from the boosting chain nodes/ classifiers by finding the 
images that are false positives (page 14, paragraph 3), use the false alarms as a 
negative training set having adjusted weights by using them to show the classifier is not 
sufficient, and training the cascade to contain more nodes and adjusting the weight of 
false positives in the false positive rate (page 14, paragraph 3), and using the negative 
training set to initiate a subsequent boosting chain node by creating another classifier if 
there is a high false positive rate (page 14, paragraph 3) and a post-filter stage 
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configured to process said set of intermediate candidate portions to produce a set of 
final candidate portions, "promising regions" (page 2, paragraph 5). The post filter stage 
Is more complex processing of finding a face (page 2, paragraph 5). Viola does not 
disclose expressly that more complex processing to find a face Includes an Image pre- 
processing process, a color-filter process, and a support vector machine process. Ai et 
al discloses a way of finding a face Includes an Image pre-processing process: creating 
a skin color model or training Images, etc (fig. 1), a color-filter process (fig. 1, "Skin color 
segmentation), and an SVM process (fig. 1, "Linear SVM classifier"). 

20. Regarding claim 26, Viola et al discloses processing said plurality of portions 
using a pre-filter stage that Is configured to output said set of Initial candidate portions 
selected from said plurality of portions based on at least one feature, a Haar- like 
feature (page 2, paragraph 3); therefore, Viola et al employs a feature-based algorithm 
in a prefilter stage.. Furthermore, the entire process uses many feature-based 
algorithms (page 3, paragraph 5). 

21 . Regarding claim 27, Viola et al discloses that at least one feature based 
algorithm uses Haar-IIke features (page 4, paragraph 2). 

22. Regarding claim 28, Viola et al discloses that at least one feature-based 
algorithm uses extended features (fig. 1 , D, which corresponds to fig. 12c of the 
applicant's specification which Is extended features). 

23. Regarding claim 29, Viola et al discloses at least one feature-based algorithm 
uses mirror Invariant features (fig. 1 , c, which corresponds to fig. 1 2e of the applicant's 
specification of mirror Invariant features). 
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24. Regarding claim 30, Viola discloses that an extra constraint of the mirror 
invariant, the 2"^^ white box in fig. 1 , is added to reduce the size of a feature set 
associated with the mirror invariant features, )page 4, paragraph 2). 

25. Regarding claim 31 , Viola et al discloses at least one feature-based algorithm 
uses variance features (fig. 1 , A, which corresponds to fig. 12h of the applicant's 
specification of variance features.) 

26. Regarding claim 43, Viola et al discloses processing said plurality of portions 
using a pre-filter stage that is configured to output said set of initial candidate portions 
selected from said plurality of portions based on at least one feature, a Haar- like 
feature (page 2, paragraph 3). 

27. Regarding claim 44, Viola et al discloses that the feature is a Haar- like feature 
(page 2, paragraph 3, lines 3-4). 

28. Regarding claims 45, by reinterpreting the pre-filter stage of Viola et al as being 
the first part "the integral image" (page 2, paragraph 3) and also part of the AdaBoost 
procedure as well from page 2, paragraph 4 and figure 6, items 1 and 2, the boosting 
chain step will be interpreted as the rest of the AdaBoost procedure that is not part of 
the pre-filter stage (fig. 6, item 3), and the post filtering stage is the "further processing" 
of fig. 6. Therefore, Viola et al discloses that the pre-filter stage includes a linear filter, 
since items 1 and 2 are filtering out rejections and are arranged in a linear fashion. The 
filter is based on a weak learner (page 12, paragraph 1). 
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29. Regarding claim 51 , Viola et a! employs a feature-based algorithm in a prefilter 
stage (page 2, paragraph 3) and the feature includes a Haar-like feature (page 2, 
paragraph 3, lines 3-4). 

Conclusion 

30. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. US200301 28877. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to KATHLEEN S. YUAN whose telephone number is 
(571 )272-2902. The examiner can normally be reached on Monday to Thursdays, 9 AM 
to 5 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jingge Wu can be reached on (571 )272-7429. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Jingge Wu/ 

Supervisory Patent Examiner, Art Unit 2624 
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